Method and apparatus for continuous compliance assessment

ABSTRACT

In various embodiments, a compliance server receives change data associated with a change captured on a target host. In various embodiments, the target host may have provided the change data in response to detecting the change, and the change data may include one or more rules, settings, and/or parameters. Also, in various embodiments, the compliance server may determine whether the one or more rules, settings, and/or parameters meet one or more compliance policies and generate one or more test results based at least on the results of the determining. Further, in some embodiments, the target host may detect a change to a rule, setting, and/or parameter based on a collection policy defining what change data is to be collected by the target host and provide data associated with the rule, setting, and/or parameter as change data to the compliance server.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No. 12/167,934, filed Jul. 3, 2008, entitled “METHOD AND APPARATUS FOR CONTINUOUS COMPLIANCE ASSESSMENT,” which is hereby incorporated by reference.

TECHNICAL FIELD

Embodiments relate to the field of compliance assessment, in particular to methods and apparatuses for performing continuous compliance assessment of target host data in response to changes on a target host.

BACKGROUND

Compliance with industry standards often requires occasional monitoring of rules, settings, and configuration parameters of computing devices. For example, one industry standard might mandate a minimum password length, and registry settings of a computing device may be monitored to determine whether minimum password lengths used by the compute device meet or exceed the industry standard. This monitoring is often initiated by a server that requests a number of client settings from a monitored computing device. Upon receiving the settings, the server may then analyze, classify, and/or store them, and issue a compliance report. If changes occur to the settings after they are reported to the server, those changes are not captured and evaluated until the next server request.

BRIEF DESCRIPTION OF THE DRAWINGS

Embodiments of the disclosure will be described by way of exemplary embodiments, but not limitations, illustrated in the accompanying drawings in which like references denote similar elements, and in which:

FIG. 1 illustrates a system-level view of various embodiments of the disclosure;

FIG. 2 illustrates an operational overview of a change collection and analysis, in accordance with various embodiments;

FIGS. 3A-3B illustrate a flow chart view of selected operations of the methods of various embodiments; and

FIG. 4 illustrates an example computer system suitable for use to practice aspects of various embodiments.

DETAILED DESCRIPTION OF ILLUSTRATIVE EMBODIMENTS

Illustrative embodiments include, but are not limited to, methods, systems, and articles for receiving, by a compliance server, change data associated with a change captured on a target host. In various embodiments, the target host may have provided the change data in response to detecting the change, and the change data may include one or more rules, settings, and/or parameters. Also, in various embodiments, the compliance server may determine whether the one or more rules, settings, and/or parameters meet one or more compliance policies and generate one or more test results based at least on the results of the determining. Further, in some embodiments, the target host may detect a change to a rule, setting, or parameter based on a collection policy defining what change data is to be collected by the target host and provide data associated with the rule, setting, or parameter as change data to the compliance server.

Various aspects of the illustrative embodiments will be described using terms commonly employed by those skilled in the art to convey the substance of their work to others skilled in the art. However, it will be apparent to those skilled in the art that alternate embodiments may be practiced with only some of the described aspects. For purposes of explanation, specific numbers, materials, and configurations are set forth in order to provide a thorough understanding of the illustrative embodiments. However, it will be apparent to one skilled in the art that alternate embodiments may be practiced without the specific details. In other instances, well-known features are omitted or simplified in order not to obscure the illustrative embodiments.

Further, various operations will be described as multiple discrete operations, in turn, in a manner that is most helpful in understanding the illustrative embodiments; however, the order of description should not be construed as to imply that these operations are necessarily order dependent. In particular, these operations need not be performed in the order of presentation.

The phrase “in one embodiment” is used repeatedly. The phrase generally does not refer to the same embodiment; however, it may. The terms “comprising,” “having,” and “including” are synonymous, unless the context dictates otherwise. The phrase “A/B” means “A or B”. The phrase “A and/or B” means “(A), (B), or (A and B)”. The phrase “at least one of A, B and C” means “(A), (B), (C), (A and B), (A and C), (B and C) or (A, B and C)”. The phrase “(A) B” means “(B) or (A B)”, that is, A is optional.

FIG. 1 illustrates a system-level view of various embodiments of the disclosure. As illustrated, a target host 102 may be communicatively coupled to a compliance server 106. The compliance server 106 may determine whether rules, settings, and/or configuration parameters of the target host 102 meet one or more compliance policies 110.

In various embodiments, target host 102 may include one or more rules or collection policies 104 for use in capturing changes to data of the target host 102, such as changes to rules, settings, and/or configuration parameters. Upon detecting/capturing a change, the target host 102 may provide data associated with the change to the compliance server 106 to store in a change database 108 of the compliance server 106. Logic of the compliance server 106 may then generate an event to notify one or more event listeners of the compliance server 106 that data associated with a new change has been stored in the change database 108. The compliance server 106 may then look up all compliance policies 110 that match collection policies or rules 104 specified in the received change data. In some embodiments, the compliance server 106 may then filter the change data and determine whether one or more rules, settings, and/or parameters of the change data meet one or more compliance policies 110. The determining may include evaluating an expression of at least one of the compliance policies 110 against element data specified in the change data. In various embodiments, the compliance server 106 may then generate test results based on whether the compliance policies 110 were met. In one embodiment, the compliance server 106 may further generate a report. The report may then be provided to target host 102, and/or an administrative user of compliance server 106, or to some other system.

In various embodiments, target host 102 and compliance server 106 may be any sort of computing devices known in the art, except for collection policies 104, change database 108, compliance policies 110, and logic configured to perform the operations discussed herein. The computing devices may be personal computers (PC), workstations, servers, routers, mainframes, modular computers within blade servers or high-density servers, personal digital assistants (PDA), entertainment centers, set-top boxes, or mobile devices. An exemplary computing device is illustrated by FIG. 4, and will be described in greater detail herein. In some embodiments, compliance server 106 and target host 102 may be deployed on computing devices of the same organization. In other embodiments, compliance server 106 may belong to a separate organization, such as a compliance monitoring organization whose purpose is to monitor and ensure industry standards. Also, in one embodiment, target host 102 and compliance server 106 may be separate logical components or virtual machines of the same computing device.

In various embodiments, as mentioned above, target host 102 may have one or more collection policies or rules 104, and compliance server 106 may have a change database 108 and one or more compliance policies 110. These components and associated data and logic are also illustrated in FIG. 2 and will be described herein in greater detail herein.

In various embodiments, where target host 102 and compliance server 106 are remotely disposed from each other, they may be communicatively coupled to each other. In some embodiments, the computing devices may be coupled by a networking fabric (not illustrated). Such a networking fabric may include one or more of a local area network (LAN), a wide area network (WAN), and the Internet, as is known in the art. In one embodiment, the networking fabric may comprise a private network or a virtual private network (VPN) that may utilize tunneling. In some embodiments, where target host 102 and compliance server 106 belong to the same organization, they may be coupled by one or more private LANs or WANs of the organization.

FIG. 2 illustrates an operational overview of a change collection and analysis, in accordance with various embodiments. In various embodiments, collecting change data 202 may be accomplished by logic of the target host applying collection policies of rules to changes that are captured/detected on the target host. In some embodiments, collection policies/rules 104 may define a period at which a snapshot of the target system is be taken. In such embodiments, the period may be constant (such as every minute) or variable (such as increased or decreased frequency based on target host 102 usage). Also, the snapshot taken may be of all rules, settings, and configuration parameters on target host 102, or may be limited to a subset, such as all registry settings. In other embodiments, collection policies or rules 104 may instead define rules, settings, or configuration parameters of the target host 102 to monitor. Monitoring of these rules, settings, or configuration parameters may be accomplished through any monitoring/listening mechanism known in the art. Collection policies or rules 104 may monitor all rules, settings, or configuration parameters, or only a subset. In various embodiments, collection policies or rules 104 may be specified in any manner, such as system addresses, command lines, or other text that is interpretable by target host 102. Further, collection policies or rules 104 may be stored in any sort of file, database, or structure of target host 102. In one embodiment, collection policies or rules may be stored remotely, such as on compliance server 106, and periodically fetched by target host 102.

In various embodiments, the captured/detected change may be associated with other descriptive data to form change data 202. For example, the change data 202 for a given change may include an identification of the node or target host 102 on which the change was captured, the rule or collection policy 104 responsible for the capturing of the change, a name of the data element (such as a rule, setting, or configuration parameter) for which the change was detected, and the element data of the element for which the change was detected. In one exemplary embodiment, if the change was detected for a minimum password length setting, the change data 202 may include the name of the setting (e.g., “minPwdLength”) and the minimum password length (e.g., 10 characters).

In some embodiments, the collection policies 104 and the logic for applying them may be used to monitor a remote host. In such embodiments, the collection policies 104 and logic may be located on compliance server 106, or another device, and may be used to remotely detect changes on a target host 102.

In various embodiments, upon being generated, change data 202 may be stored in change database 108. As mentioned above, in some embodiments change database 108 may be a database of the compliance server 106. In other embodiments, change database 108 may reside on a different computing device then compliance server 106. For example, change database 108 may reside on a database server device that is communicatively coupled to compliance server 106. Further, in various embodiments, change database 108 may be any sort of database known in the art, such as a relational database, a normalized or de-normalized database, a data structure, or an unformatted file. In some embodiments, change database 108 may store all change data 202 received from target hosts. In other embodiments, change database 108 may have a data retention policy and may discard change data 202 after a specified/pre-determined duration of time.

As mentioned previously, upon new change data 202 being stored in change database 108, an event may be generated to notify logic of compliance server 106 of the arrival of the change data 202. Such logic may include one or more event listeners configured to detect events as they are generated. Upon detecting an event, the logic of compliance server 106 may look up tests/compliance policies 110 (hereinafter “compliance policies 110”) that match collection policies or rules 104 specified in the received change data 202. For example, if a collection policy 104 specified monitoring of a minimum password length, a compliance policy 110 specifying a minimum password length standard may be determined to be a match. Also, in some embodiments, compliance policies 110 may include elements specifying collection policies 104 to which they may apply. In such embodiments, determining matches may simply comprise comparing compliance policy 110 elements to collection policies 104 of change data 202 to determine if the elements specify the collection policies 104.

In various embodiments, compliance policies 110 may each comprise a number of elements. For example, a compliance policy 110 may specify a rule or collection policy 104, a change name (such as a name of the target host 102 data element for which a change was detected), one or more waivers from the compliance policy 110, and an expression for evaluating element data of the change data 202. In some embodiments, the collection policy 104 may correspond to a collection policy 104 specified in change data 202 and the change name may correspond to the element name specified in change data 202. Also, the waivers may specify whether a target host 102 identified by change data 202 is exempted from the compliance policy 110. In some embodiments, the expression may include one or more conditions that are to be applied to data elements of change data 202 to determine whether the data elements are in compliance with the policy 110. In various embodiments, compliance policies 110 may be specified in any manner, such as, for example, tables, collections of tables, lists, or other data structures. Further, compliance policies 110 may be stored in any sort of file, database, or structure of compliance server 106. In one embodiment, compliance policies 110 may be stored remotely and fetched by compliance server 106.

In some embodiments, compliance server 106 may receive or retrieve new or updated compliance policies 110, periodically or as they become available. In one embodiment, such new or updated policies may be retrieved or received from a service or a compliance standards organization that defines industry standards.

In various embodiments, logic of compliance server 106 may filter 204 change data 202 after looking up matching compliance policies 106. As illustrated in FIG. 2, filtering 204 change data 202 may include performing a number of narrowing determinations to ensure that the policies 110 are only applied to the target hosts 102 and changes to which they are intended to apply. For example, a first of these filtering operations 204 has already been mentioned: comparing a rule/collection policy 104 specified in an element of the compliance policy 110 to a rule/collection policy 104 specified in the change data. If there is a match, further filtering operations 204 may be performed. For instance, compliance server 106 may check whether the target host/node 102 is listed in a waivers list element of a compliance policy 106. Then, if the target host 102 specified in the change data is not present in the waivers list, the compliance server 106 may determine whether a change name specified in the compliance policy 110 matches an element name specified in the change data 202, such as the element name described previously. If there is a match, the compliance server 106 may then apply the compliance policy 110 to the change data.

In some embodiments, the compliance server 106 may apply a compliance policy 110 to change data 202 to determine whether the one or more rules, settings, and/or configuration parameters specified in the change data meet one or more compliance policies 110. As previously mentioned, the rules, settings, and/or configuration parameters may be specified by the element name and element data of change data 202. And as illustrated, that determining may comprise evaluating 206 an expression specified in a compliance policy 110 against element data specified in the change data 202. For example, the expression of the compliance policy may specify that all passwords must be at least 10 characters long, and the element data of change data 202 may specify that a recently changed password setting requires passwords to be at least 9 characters long. Such an evaluation may then indicate that the password setting of the target host 102 is not in compliance with compliance policy 110.

In various embodiments, the compliance server may then generate 208 a test result based on the determining/evaluating. The test result may indicate either that the rule, setting, or configuration parameter specified in change data 202 is in compliance or not in compliance with compliance policy 110. In various embodiments, the test results may then be stored in a test results database (not illustrated). In one embodiment, the test results database may be identical to the change database. In some embodiments, the compliance server 106 may then generate a report based on the test result and may store the report or provide it to the target host 102, an administrative user through a user interface of compliance server 106, and/or some other system. The report may include an indication of whether or not a given rule, setting, or parameter is in compliance and, if not in compliance, an indication of what an appropriate value or values for a compliant rule, setting, or parameter would be. In one embodiment, the compliance server 106 may provide the report to an industry standards/compliance monitoring organization.

In some embodiments, upon receiving a report indicating that a rule, setting, or parameter is not in compliance, target host 102 may take a remedial measure to place the rule, setting, or change in compliance.

FIGS. 3A-3B illustrate a flow chart view of selected operations of the methods of various embodiments. As illustrated, a compliance server may receive change data associated with a change captured on a target host, block 304, the target host providing the change data in response to detecting the change, and the change data including one or more rules, settings, and/or parameters. In some embodiments, the change data may include a rule that generated the change, the target host or node that the change data was collected from, a specific element name associated with the change, and element data associated with the change.

As is further illustrated, the compliance server may store the received change data in a change database, block 306. Also, in response to receiving the change data, the compliance server may generate an event to indicate receipt of the change data, block 308. The compliance server may then lookup all compliance policies that match collection policies or rules specified in the received change data, block 310. In various embodiments, each compliance policy may include a rule or collection policy, a change name, one or more waivers from the compliance policy, and an expression for evaluating element data of the change. Also, in some embodiments, the compliance server may receive or retrieve new or updated compliance policies, block 302, from another server, system, or storage.

In various embodiments, the compliance server may then filter the change data, blocks 312 a-312 c. As illustrated in FIG. 3B, the filtering may include comparing a first rule specified in the change data with a second rule specified in the one or more compliance policies, block 312 a, determining whether a target host or node specified in the change data is associated with one or more waivers specified by the one or more compliance policies, block 312 b, and/or comparing an element name specified in the change data with a name specified in the one or more compliance policies, block 312 c.

As illustrated in FIG. 3A, the compliance server may then determine whether the one or more rules, settings, and/or parameters meet one or more compliance policies, block 314. In some embodiments, the determining may be conditionally performed based on a result of the filtering. Also, the determining may be performed in response to the generating of the event, block 308. In various embodiments, the determining may include evaluating an expression of at least one of the compliance policies against element data specified in the change data.

In some embodiments, the compliance server may then generate one or more test results based at least on the results of the determining, block 316. In such embodiments, the generating may comprise generating a report to the target host and/or an administrative user.

Also, in various embodiments, the compliance server may repeat the receiving, determining, and generating in real time each time the target host captures an additional change.

FIG. 4 illustrates an exemplary computer system suitable for use to practice aspects of various embodiments. As may be seen, computing system 400 includes a number of processors or processor cores 402, and system memory 404. For the purpose of this application, including the claims, the terms “processor” and “processor cores” may be considered synonymous, unless the context clearly requires otherwise. Additionally, computing system 400 includes mass storage devices 406 (such as diskette, hard drive, compact disc read only memory (CDROM), a disc storage device, and so forth), input/output devices 408 (such as display, keyboard, cursor control and so forth) and communication interfaces 410 (such as network interface cards, modems and so forth). The elements are coupled to each other via system bus 412, which represents one or more buses. In the case of multiple buses, they are bridged by one or more bus bridges (not illustrated).

Each of these elements performs its conventional functions known in the art. In particular, system memory 404 and mass storage 406 may be employed to store a working copy and a permanent copy of the programming instructions implementing one or more aspects of the above described teachings to practice the various embodiments, herein collectively denoted as 422. The various components may be implemented by assembler instructions supported by processor(s) 402 or high-level languages, such as, for example, C, that may be compiled into such instructions.

The permanent copy of the programming instructions may be placed into permanent storage 406 in the factory, or in the field, through, for example, a distribution medium (not illustrated), such as a compact disc (CD), or through communication interface 410 (from a distribution server (not illustrated)). That is, one or more distribution media having an implementation of the agent program may be employed to distribute the agent and program various computing devices.

The constitution of these elements 402-412 are generally known to one skilled in the art, and accordingly will not be further described.

In embodiments of the present invention, an article of manufacture (not illustrated) may be employed to implement one or more methods as disclosed herein. For example, in exemplary embodiments, an article of manufacture may comprise a storage medium and a plurality of programming instructions stored on the storage medium and configured to program a target host to detect a change to a rule, setting, or parameter based on a collection policy defining what change data is to be collected by the target host, and provide data associated with the rule, setting, or parameter as change data to a compliance server. The compliance server may determine whether the rule, setting, or parameter meet one or more compliance policies. In other exemplary embodiments, the plurality of programming instructions may be configured to program a compliance server to receive data associated with a change captured on a target host, the target host providing the data in response to detecting the change, and the data including one or more rules, settings, and/or parameters. The instructions may further be configured to determine whether the one or more rules, settings, and/or parameters meet one or more compliance policies, and to generate one or more test results based at least on the results of the determining.

Although specific embodiments have been illustrated and described herein, it will be appreciated by those of ordinary skill in the art that a wide variety of alternate and/or equivalent implementations may be substituted for the specific embodiments illustrated and described, without departing from the scope of the embodiments. This application is intended to cover any adaptations or variations of the embodiments discussed herein. Therefore, it is manifestly intended that the embodiments be limited only by the claims and the equivalents thereof. 

What is claimed is:
 1. A method comprising: receiving, by a server, change data associated with a change detected by a target host, wherein the target host applies one or more collection policies defining what types of change data are to be detected by the target host and provides the change data in response to detecting that one or more rules, settings, and/or parameters at the target host, defined by a respective one of the one or more collection policies, have changed, wherein the change data includes an identification of the target host, an identification of the respective one of the one or more collection policies responsible for the change data, and the one or more changed rules, settings, and/or parameters; filtering, by the server, the received change data, wherein the filtering includes determining whether the target host specified in the change data is associated with one or more waivers specified by one or more compliance policies; and conditional on the target host not being associated with the one or more waivers specified by the one or more compliance policies, determining, by the server, whether the one or more rules, settings, and/or parameters meet the one or more compliance policies and generating one or more test results based at least on the determining.
 2. The method of claim 1, further comprising storing, by the server, the received change data in a change database.
 3. The method of claim 1, wherein the change data includes a rule that generated the change, a specific element name associated with the change, and element data associated with the change.
 4. The method of claim 1, wherein each of the one or more compliance policies includes a rule and an expression for evaluating element data of the change.
 5. The method of claim 1, wherein the determining comprises evaluating an expression of at least one of the one or more compliance policies against element data specified in the change data.
 6. The method of claim 1, wherein the generating the one or more test results comprises generating a report to an administrative user.
 7. The method of claim 1, further comprising receiving or retrieving, by the server, new or updated compliance policies.
 8. The method of claim 1, further comprising repeating the receiving, the filtering, and the conditional determining and generating in real time each time the target host captures an additional change.
 9. The method of claim 1, wherein one or more of the one or more collection policies are periodically received from the server.
 10. A compliance server comprising: a memory or storage device storing a change database for storing change data associated with a change captured on a target host, wherein the target host applies a plurality of collection policies defining what types of change data are to be detected by the target host and provides the change data in response to detecting the change, wherein the change data includes an identification of the target host, an identification of the respective one of the plurality of collection policies responsible for the change data, and one or more changed rules, settings, and/or parameters; and a hardware processor, the hardware processor being programmed to: receive, from the target host, the change data associated with the change captured on the target host, filter the received change data, the filtering including determining whether the target host specified in the change data is associated with one or more waivers specified by one or more compliance policies, and if the target host is not associated with the one or more waivers specified by the one or more compliance policies, determine whether the one or more changed rules, settings, and/or parameters meet the one or more compliance policies and generate one or more test results based at least on the determining.
 11. The compliance server of claim 10, further comprising an event listener to listen for generated events.
 12. The compliance server of claim 10, wherein the one or more compliance policies ensure that the target host is in compliance with one or more standards.
 13. The compliance server of claim 10, wherein the hardware processor is further programmed to evaluate an expression of at least one of the one or more compliance policies against element data specified in the change data.
 14. A method comprising: monitoring a change database to detect whether any new change data has been received from target hosts; upon detecting the new change data in the change database, notifying logic of a server of the new change data, the new change data being associated with a change captured on a target host, wherein the target host applies one or more collection policies defining what types of change data are to be detected by the target host and provides the new change data in response to detecting the change, wherein the new change data includes data identifying the target host, data identifying a respective one of the one or more collection policies responsible for the change data, and data identifying a change to a registry setting or configuration parameter at the target host; determining, by the server, whether the change to the registry setting or configuration parameter meets one or more compliance policies; generating, by the server, one or more test results based at least on the determining; and when the change to the registry setting or configuration parameter does not meet the one or more compliance policies, generating appropriate element data for the target host to place the target host into compliance with the one or more compliance policies.
 15. The method of claim 14, wherein the new change data includes a rule that generated the change, a specific element name associated with the change, and element data associated with the change.
 16. The method of claim 14, wherein each of the one or more compliance policies includes one or more of a rule, a change name, one or more waivers from the policy, or an expression for evaluating element data of the change.
 17. The method of claim 14, further comprising receiving or retrieving, by the server, new or updated compliance policies stored remotely from the server.
 18. The method of claim 14, wherein the one or more compliance policies ensure that the target host is in compliance with one or more standards.
 19. A method comprising: monitoring a change database to detect whether any new change data has been received from target hosts; upon detecting the new change data in the change database, notifying logic of a server of the new change data, the new change data being associated with a change detected at a target host, wherein the new change data includes data identifying the target host and data identifying a change to a registry setting or configuration parameter at the target host; determining, by the server, whether the change to the registry setting or configuration parameter meets one or more compliance policies; generating, by the server, one or more test results based at least on the results of the determining; and when the change to the registry setting or configuration parameter does not meet the one or more compliance policies, generating appropriate element data for the target host to place the target host into compliance with the one or more compliance policies, wherein the new change data includes a rule that generated the change, an identification of the target host from which the change data was collected, a specific element name associated with the change, and element data associated with the change.
 20. The method of claim 19, wherein each compliance policy includes one or more of a rule, a change name, one or more waivers from the policy, or an expression for evaluating element data of the change.
 21. The method of claim 19, further comprising receiving or retrieving, by the server, new or updated compliance policies stored remotely from the server.
 22. The method of claim 19, wherein the one or more compliance policies ensure that the target host is in compliance with one or more standards.
 23. A non-transitory storage medium storing computer-executable instructions which when executed by a computing device of a server cause the computing device to perform a method, the method comprising: monitoring a change database to detect whether any new change data has been received from target hosts; upon detecting the new change data in the change database, notifying logic of a server of the new change data, the new change data being associated with a change detected at a target host, wherein the new change data includes data identifying the target host and data identifying a change to a registry setting or configuration parameter at the target host; determining, by the server, whether the change to the registry setting or configuration parameter meets one or more compliance policies; generating, by the server, one or more test results based at least on results of the determining; and when the change to the registry setting or configuration parameter does not meet the one or more compliance policies, generating appropriate element data for the target host to place the target host into compliance with the one or more compliance policies, wherein the new change data includes a rule that generated the change, an identification of the target host from which the change was collected, a specific element name associated with the change, and element data associated with the change.
 24. The non-transitory storage medium of claim 23, wherein each compliance policy includes one or more of a rule, a change name, one or more waivers from the policy, or an expression for evaluating element data of the change.
 25. The non-transitory storage medium of claim 23, further comprising receiving or retrieving, by the server, new or updated compliance policies stored remotely from the server.
 26. The non-transitory storage medium of claim 23, wherein the one or more compliance policies ensure that the target host is in compliance with one or more standards. 